Click any tag below to further narrow down your results
Links
Mark Zuckerberg criticized Anthropic's push for a global AI slowdown, arguing that companies can manage safety risks on their own without industry-wide pauses. He positioned Meta as already doing this work internally with products like its new Muse agent.
- Zuckerberg said labs have "responsibility and incentive" to train models safely without needing external pressure, contrasting with Amodei's call for a coordinated global slowdown
- Meta delayed releasing Muse for several months to ensure security, which Zuckerberg offered as proof companies can self-regulate
- Zuckerberg took a jab at competitors pursuing "recursive self-improvement" (using AI to develop itself), calling it misguided compared to serving users
AWS is rolling out access to Anthropic’s Claude Fable 5 model via Amazon Bedrock, with account availability based on Bedrock usage or AWS Support requests. The service routes harmful prompts to the Opus 4.8 model to reduce costs and applies 30-day data retention for all Mythos-class model traffic.
- Claude Fable 5 is rolling out on AWS Bedrock, with access tied to usage levels or expedited via AWS Support requests
- Prompts flagged as harmful get automatically rerouted mid-conversation from Fable 5 to Opus 4.8, with billing split between Fable rates before the block and Opus rates after
- Anthropic retains all input/output traffic for 30 days across Mythos-class models (Fable 5, Mythos 5, and future equivalents) for safety monitoring
- This appears to be satirical/fictional content, as "Claude Fable 5," "Mythos-class," and "Opus 4.8" are not real Anthropic products or model names
Anthropic's AI tool, Claude, has gained significant traction among consumers, with paid subscriptions more than doubling this year. The growth coincides with a public feud with the Department of Defense and effective Super Bowl ads that positioned Claude as a safer alternative to competitors. Despite this success, Claude still trails behind ChatGPT in overall user numbers.
- Claude's paid subscriptions have more than doubled in 2024, based on analysis of ~28 million anonymized US credit card transactions, with a sharp jump between January and February.
- Most new subscribers are choosing the cheapest $20/month "Pro" tier rather than the $100 or $200 plans, with growth also driven by new features like Claude Code, Claude Cowork, and Computer Use.
- Anthropic's public refusal to let its AI be used for lethal military operations (unlike OpenAI, which struck its own DoD deal) plus Super Bowl ads mocking ChatGPT have boosted Claude's profile as a "safer" alternative.
- Despite this growth, Claude still trails ChatGPT in total users, and OpenAI continues adding paid subscribers quickly despite backlash over its DoD deal.
The article discusses the new version of Claude's constitution, which outlines explicit values for AI behavior. It explains how Constitutional AI improves upon traditional human feedback by using AI-generated principles to ensure safer and more transparent model outputs. The principles aim to address ethical concerns while allowing for continuous improvement.
- Constitutional AI replaces most human feedback with AI self-critique against a written constitution, then AI-generated reinforcement learning for harmlessness, cutting the need for people to review toxic content.
- Claude trained this way got better at handling adversarial prompts without becoming less helpful, and the approach makes the values steering the model's outputs more transparent.
- The constitution draws on sources like the UN Declaration of Human Rights and other labs' safety practices, but Anthropic admits it's still skewed toward Western viewpoints and remains a work in progress shaped by trial and error.
Anthropic has published a constitution for its AI model, Claude, detailing the values and behaviors it should embody. This document serves as a guiding framework for Claude's training and decision-making processes, focusing on safety, ethics, and helpfulness.
- Anthropic replaced Claude's old list of standalone principles with a constitution that explains the reasoning behind behaviors, not just rules to follow
- Claude is instructed to prioritize being safe, then ethical, then compliant with Anthropic's guidelines, then genuinely helpful, in that order when conflicts arise
- The document is released under CC0 1.0, so anyone can use it freely
- Anthropic uses the constitution to generate synthetic training data that shapes Claude's judgment during actual training stages